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A Bit of Context 


The Python Scientific Stack 


— Python, modern computing script language 
— ІРуіһоп, an advanced Python shell 

— Numpy, powerful numerical arrays objects. 
— Scipy, high-level data processing routines. 
— Matplotlib, 2-р visualization plots 


Versatile, beautiful but... slow ! 


Matplotlib is a python plotting library, primarily for 2-D plotting, but with some 3-D support, 
which produces publication-quality figures in a variety of hardcopy formats and interactive 
environments across platforms. 


— Antigrain geometry, High Fidelity 2D Graphics (www.antigrain.com) 


— Ten Simple Rules for Better Figures, Nicolas P. Rougier, Michael Droettboom, Philip E. 
Bourne PLoS Computational Biology, Vol. 10, No. 9. 


What about OpenGL ? 


GaForee GTX TITAN. 


NVIDIA GPU SP 


Powerful, fast but... ugly ! ші 
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е Nodecent anti-aliasing 
e Only two image filters 
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• No native text handling 
е No markers, no arrows 
® No paths, no curves so 
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Proprietary solution 


— Mark Kilgard and Jeff Bolz, GPU-accelerated Path Rendering, ACM Transactions on 
Graphics (Proceedings of SIGGRAPH Asia 2012), vol. 31, Num. 6, (2012). 


— Орепуб API, Standard for Vector Graphics Acceleration, Khronos group. 


But this can also be fixed freely ! 


Rendering framework 


e Pyglet 


www. pyglet.org 


e PyOpenGL 


pyopengl.sourceforge.net 


Visualization framework 


e mayavi 2 (Enthought) 
github.con/enthought/mayavi 
e VTK (Kitware) 
www. vtk.org 


° galry (Cyrille Rossant) 


rossant.github.io/galry/ 


Python/OpenGL frameworks 


e Nodebox for OpenGL 


www.cityinabottle.org/nodebox 


e PyProcessing 


code. google. com/p/pyprocessing 


ө visvis (Almar Klein) 
code. google. com/p/visvis/ 

e glumpy (Nicolas Rougier) 
code. google.com/p/glumpy/ 

e pyqtgraph (Luke Campagnola) 
www.pyqtgraph. org 


Е5 1.0 ES11 


OpenGL history 
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Fixed pipeline Programmable pipeline 
(no shaders) (vertex/fragment/geometry shaders) 
к >l 
Legacy OpenGL Core Profile 


Doom (1993) 


(deprecation model) 


Rage (2011) 


OpenGL 4.2 pipeline overview 


(could have been worse...) 


Around 2000 constants and 1000 functions. 
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OpenGL ES 2.0 pipeline overview 


Around 350 constants and 150 functions. 


(openglinsights.com) 


‘OpenGL ES 2.0 Pipeline Overview 
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Fail tests or discarded (9) 


Pixel 


Nowrite 69 


‘OpenGL ES 2.0 Vertex Processing 
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‘OpenGL ES 2. Primitive Processing 


Primitive. 


Perspective. 
Division (2.12) 


Primitive 
Clipping ( 


Opent. 


ES 2.0 Rasterization 
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Mapping 
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Line Segments 
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Depth offset 
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OpenGL ES 2.0 Fragment Processing 
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Pixel 
Ownership 


Multisample 
Fragment Op. 
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Depth Buffer 
Test 4.1.5) 


Fragment 
Shading 


Stencil Test 


‘OpenGL ES 2.0 Pixel Processing 
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Pipeline overview 


Data centered 


CPU GPU 


(python) (shaders) 


Raw Baked Transformed Rendered 
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Critical parts are the baking process and the transfer to GPU memory. 


Baking process 


Ideal case: no baking 


GPU 


Interpolation, colorization, leveling, 
gridding, scaling, lighting, aliasing, 
rendering entirely done on GPU. 


Hard case: baking depends on transformation 


Transparency implies lot of CPU 
processing (sorting) or multi-pass 
rendering. 


Statue, 450K triangles Lucy, 113K triangles Dragon, 460K triangles 


Scalable Vector Graphics (SVG) 2 
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Paths 

Basic shapes 

Painting: Filling, Stroking and Marker Symbols 
Clipping, Masking and Compositing 

Filter Effects 


Where do we start ? 


Text rendering 


Different techniques 
Bitmap, stroke, texture, sdf, vector... 
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— Nicolas Р. Rougier, Higher Quality 2D Text Rendering, Journal of Computer Graphics 
Techniques (JCGT), vol. 2, no. 1, 50-64, 2013. 


Higher quality text rendering 


Vertical vs Horizontal hinting 


No hinting Native hinting Auto hinting Vertical hinting 


— Maxim Shemarev, Texts Rasterization Exposures, An attempt to improve text 
rasterization algorithms, 2007 


Implementation (github. com/rougier/freetype-gl) 


e Subpixel positioning & kerning 
e Per pixel gamma correction 
e Signed Distance Fields 


Dashed stroked polyline 


GL line width (fixed pipeline) GL Stipple (fixed pipeline) 
e Limited in thickness e Limited in pattern 
e Nocontrol over joins and caps e Nocontrol over dash caps 
e Deprecated & ugly e Deprecated & ugly 
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Higher quality dashed stroked polyline 


Shader based approach 

Anew method for rendering arbitrary dash patterns along any continuous polyline (smooth 
or broken). The proposed method does not tessellate individual dash patterns and allows for 
fast and accurate rendering of any user-defined dash pattern and caps 


— Nicolas P. Rougier, Shader-Based Antialiased, Dashed, Stroked Polylines, Journal of 
Computer Graphics Techniques (JCGT), vol. 2, no. 2, 105-121, 2013. 


Image interpolation & filters 


OpenGL offers only nearest and linear filters while much more are needed for scientific 
visualization (Hanning, Hamming, Hermite, Kaiser, Quadric, Bicubic, CatRom, Mitchell, 
Spline16, Spline36, Gaussian, Bessel, Sinc, Lanczos, Blackman, etc.) 


— Kevin Bjorke, High-Quality Filtering in GPU gems 2 : programming techniques for 
high-performance graphics and general-purpose computation / edited by Matt Pharr ; 
Randima Fernando (2007). 


Grids, markers and arrows 


Point based approach 


Anew method for drawing grids, markers, and arrows using implicit functions such that it is 
possible draw pixel-perfect antialiased objects with very good performances. 


SAY 
EA 


— Nicolas P. Rougier, Shader Based Antialiased 2D Grids, Markers, and Arrows, Journal of 
Computer Graphics Techniques (JCGT), to appear, 2014. 


Still lot of problems ahead... 


„but work is in progress 


Shader composition 
How to define a shader format that allow easy composition/templating ? 


Level of details 
How to set automatic level of details ? 


Very big data 


How to render data that doesn't even fit into GPU memory ? 


Complex data transformation 
How to handle user-supplied exotic transformation ? 


From DesktopGL to WebGL 
How to render in browser from a python session ? 


Conclusion 


We do not have to (always) trade quality for speed 


1,000,000 pts - 40 FPS 10,000,000 pts - 1.5 FPS 
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AntiGrain Geometry OpenGL AntiGrain AntiGrain Geometry OpenGL AntiGrain 
(matplotlib agg backend) (using dedicated shaders) (matplotlib agg backend) (using dedicated shaders) 


Informations & links 


The code is spread in several projects but should be soon integrated in the master vispy 
project. 


Projects page Code repositories 

e vispy.org Ф github.com/vispy/vispy 

® vispy.org/gallery.html e github. com/glumpy/glumpy 

* glumpy.github.io * github.com/rougier/gl-agg 

* glumpy.github.io/gallery.html * github.com/rougier/freetype-gl 
Demo pages 


e Markers: https: //www.shadertoy.com/view/XsXXDX 

* Arrows: https: //www.shadertoy.com/view/1d1SWj 

e Transverse Mercator grid: https: //www.shadertoy.com/view/lsSXzm 
e Cartesian grid: https: //www.shadertoy.com/view/MdSXRm 

e Polar grid: https: //www.shadertoy.com/view/MsBSRm 
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